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ABSTRACT 



The JINTACCS program was established to insure the 
interoperability of tactical command and control systems 
used in joint military operations. One of the standards 
JINTACCS has developed is a message format to enhance the 
exchange of written information within the joint task force. 
This research investigated the susceptibility of the 
JINTACCS message formats used in air operations to jamming. 

The susceptibility was measured by comparing the percent of 
understandability of JINTACCS messages to all plain text 
non-forma tted messages after each had been subjected to 
equal levels of electronic jamming. Continuous and burst 
jamming were modeled for this experiment. The experimental 
results revealed no statistically significant differences in 
the percent of understandability between the JINTACCS messages 
and the plain text messages. Curves of understandability 
were established from the experimental results for different 
levels of continuous jamming and different levels of burst 
jamming . 
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I . BACKGROUND LEADING TO EXPERIMENT 
A. INTRODUCTION 

The Joint Interoperability of Tactical Command and 
Control Systems (JINTACCS) program was established by the 
Department of Defense in 1971. It is a joint service inter- 
face program designed to develop standards and procedures to 
insure the interoperability and operational effectiveness of 
those tactical command and control systems used in support 
of joint and combined ground and amphibious military opera- 
tions. One of the standards JINTACCS has developed is a 
message format to enhance the exchange of information witliin 
the joint task force. The purpose of this thesis is to 
evaluate the susceptibility of the JINTACCS message format 
to two different types of electronic jamming. The evaluation 
consists of an experiment where JINTACCS formatted messages 
are compared to plain text non-formatted messages given an 
equal amount of jamming for each message. 

The reasons behind this thesis are as follows. In the 
tactical battlefield environment our message communications 
are subject to two specific types of electronic jamming: 
continuous and burst. With the new JINTACCS message formats, 
it is important to consider the effects of jamming on the 
understandability of these messages before the services 
implement the system. Experiments such as those performed 
in this research effort can hopefully reveal that, at the 
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very least, the U.S. services are no worse off using the 
JINTACCS format with respect to jamming susceptibility. 

Also these types of experiments may point out weak areas 
where the effectiveness or understandability of the JINTACCS 
message format can be improved. In the joint tactical envi- 
ronment, the communication of critical information between 
force elements directly affects the success or failure of 
the mission. It is hoped that research such as this will 
contribute to success in the joint arena. 

B . JINTACCS 

1. Purpose 

The JINTACCS program was established by the Depart- 
ment of Defense with the overall goal of achieving inter- 
operability of tactical command and control systems in joint 
and combined operations. Interoperability is defined here 
as the capability of one service to operate with one or more 
of the other services in order to increase efficiency, 
mission effectiveness, or combat power. The key to inter- 
operability is compatibility because it is only when all 
service forces can exchange information in near real time 
under extreme combat conditions that interoperability is 
achieved [Ref. IJ . One part of the JINTACCS program is to 
develop standard message formats that can be used and 
understood by all services in a joint arena. 
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Overview 



2 . 

The JINTACCS program is a continuation and consoli- 
dation of previous DOD efforts to achieve interoperability 
of tactical command and control systems in joint operations. 
The need for the program was driven by the proliferation of 
sophisticated weaponry and computers on today's battlefield. 
Traditionally, combat tasks have been relatively straight- 
forward with manual procedures using people as the medium to 
achieve interoperability. In the 1960 's the use of automa- 
tion for tactical systems' tasks increased greatly. Today, 
all services are actively pursuing automation across the 
tactical equipment spectrum, resulting in the fact that we 
can no longer rely on manual procedures nor people to 
provide interoperability [Ref. 2]. 

Several lessons were learned from our tactical 
operations in Southeast Asia, the WESTPACNORTH interface 
program and the Tactical Air Control Systems/Tactical Air 
Defense Systems (TACS/TADS) interface program. Two lessons 
were the recognition that after-the-fact system integration 
is both costly and time consuming. Another lesson was that 
joint interoperability is especially difficult after a 
service's automated systems are put into operation. Also, 
we learned that standardization among the services can solve 
some of the problems, but joint service support is essential 
for standardization to be achieved [Ref. 3]. From this 
experience and these lessons, the JINTACCS program was 
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established by the Joint Chiefs of Staff (JCS) in 1971 
[Ref. 4]. 

The mission of the JINTACCS program is "to insure 
that in-service and joint plans are developed to achieve 
technical compatibility and that tests and demonstrations 
are conducted to exhibit the compatibility, interoperability 
and operational effectiveness of those tactical command and 
control systems used in support of ground and amphibious 
military operations" [Ref. 5]. 

The JINTACCS program methodology is a four step 
process. The first step was the development of the program 
architecture, including the information to be exchanged 
between tactical operational facilities. The next step was 
the development of an engineering implementation plan that 
specifies the technical standards required to achieve com- 
patibility and interoperability as specified in the program 
architecture. This includes the message standards and 
implementation methods that should be used. Because of its 
size, the JINTACCS effort was divided into five separate 
functional segments: intelligence, fire support, amphibious 

operations, operations control, and air operations. A 
JINTACCS computer library was established where all message 
elements are categorized. The third step of the program is 
to develop the test documents, conduct compatibility and 
interoperability testing, demonstrate operational effective- 
ness, and document the results. The fourth and final step 
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of the JINTACCS program will be the publication of approved 
documents and standard data elements and sets [Ref. 6]. 

The standards and procedures established by the 
JINTACCS program are designed to provide a more effective 
exchange of information within the joint task force. The 
JINTACCS message formats were developed by operational 
experts, joint committees and engineers to satisfy the 
following standards and procedures [Ref. 7] : 

a) Message standards must be man and machine 
readable 

b) A Message Element Dictionary must be used to 
insure information is understood by all players 

c) Interface operating procedures will insure the 
right messages go to the right people at the 
right time over the right communications 

d) Data standards will insure machines and 
communications work together. 

As the new language of battle, JINTACCS messages 
must be understood by all players in the joint task force 
environment. Any ambiguities in the meanings of words, 
phrases, or terms between services must be eliminated to 
effectively coordinate the use of people, weapons, and 
resources. The JINTACCS standards and procedures are 
designed to meet these goals. 
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C. JAMPS 



1 . Purpose 

The JINTACCS Automated Message Preparation System 
(JAI4PS). is designed to implement the. JINTACCS joint message 
standard after 1985. It is an automated system that will 
facilitate JINTACCS message preparation by operations per- 
sonnel and that will provide for a graceful transition to 
JINTACCS. The JINTACCS Technical Interface Design Plans, 
Message Element Dictionary, and Catalog of Keyword Data 
Sets contain over 5,000 pages of JINTACCS message preparation 
guidance. JAMPS utilizes computer terminals for message 
preparation that make those 5,000 pages of guidance trans- 
parent to the operator. JAMPS provides menu selection for 
message preparation, automatically formats message fields, 
provides editing capability, generates standard message 
headers and trailers, and sends and receives the prepared 
messages. In short, JAMPS will provide tactical commanders 
and operators with an automated capability to deal with 
JINTACCS message standards in a joint tactical environment 
[Ref. 8]. 

2 . Overview 

The basis for Air Force support of the JINTACCS 
program was established by Program Management Directive 
(PMD) R-S-9057 (1) /64779F, 12 April 1979. The PMD directed 
Tactical Air Command (TAC) to serve as the lead command for 
JINTACCS Operational Effectiveness Demonstration (OED) 
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planning and execution and to give due consideration to 
automated systems [Ref. 9] . 

An Intelligence OED performed in 1981 demonstrated 
the difficulty in preparing JINTACCS messages manually. If 
the messages are difficult to prepare manually, that is, if 
no automated assistance is available, it was believed that 
operators would view the JINTACCS standard as unacceptable 
[Ref. 10]. In addition, the JINTACCS messages are designed 
to be machine processable as well as human-readable. Without 
automating JINTACCS , the standard for them to be machine 
processable cannot be tested [Ref. 11]. For these reasons, 
the JAMPS requirement was identified. 

The JAMPS software was designed to provide many 
capabilities while remaining flexible for possible future 
requirements or changes. It was built on a modular concept 
and uses tables external to the program code to store infor- 
mation on the JINTACCS standard. This allows changes to the 
JINTACCS standards to be made quickly as no reprogramming is 
required. The JAMPS software is designed to [Ref. 12]: 

a) Prompt operations personnel during message 
preparation 

b) Format message fields and segments in 
conformance with JINTACCS rules 

c) Provide message editing capabilities 

d) Generate the standard message header and 
trailer information 
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e) Maintain message history files that sequentially 
store all incoming and outgoing messages 

f) Display and provide record copies of incoming 
and outgoing messages as required. 

Because of the above, the JAMPS software should be 
"user friendly" and should insure that operators generate 
accurate JINTACCS messages. This should, in turn, enhance 
the exchange of critical information on the tactical battle- 
field and therefore improve interoperability. 

In addition, the JAMPS software was designed to 
accommodate a wide range of operator expertise. The software 
appears totally menu driven to the novice operator and allows 
the operator to choose from sets of alternatives. Detailed 
descriptions are provided at each point to "step" the opera- 
tor through the process. On the other hand, an experienced 
JAMPS operator can bypass the cumbersome hand-holding modes 
and complete a message directly and quickly. The experienced 
operator can still obtain help, if required, at any point. 
Finally, the JAMPS software includes a developmental toolkit 
with a thorough and repeatable test of the software, an 
"instant replay" of any JAMPS session to help identify and 
correct any unanticipated problems, and a means for obtaining 
message preparation statistics [Ref. 13]. 

The hardware for JAMPS is also of modular design. 

The Phase I version of JAMPS that is now in use at Head- 
quarters TAG relies on a single central processing unit (CPU) , 
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a PDP-11/70, connected to a number of "dumb" terminals, 
Perkin-Elmer OWL 1200 's. This configuration is what was 
used for the experiment conducted in this research. Phase 
II requirements for JAMPS are being worked at this time to 
provide the hardware for post-1985 JINTACCS command and 
control communications requirements [Ref. 14]. 

Overall, the present JAMPS provides an automated 
message preparation/communication capability that is "user 
friendly" and that makes the JINTACCS message standards 
transparent to the operators. The design of the system 
allows quick changes or modifications to the message formats 
without changing the program code. The Phase I system that 
is presently installed at Headquarters TAC is a strong first 
step towards automating command control communications in a 
tactical environment. It served as a good testbed for this 
experiment. 

D. ELECTRONIC JAMMING 

Electronic jamming of a data communications link can take 
many forms. The two jamming forms examined in this experi- 
ment are continuous and burst jamming. A brief description 
of each is given below with an explanation of the way each 
was modeled. 

In continuous jamming a constant level signal is trans- 
mitted continuously at the same frequency at which the 
jammed link or net is operating. To be most effective, the 
type of signal modulation should be the same as the signal 
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being jammed, although this is not necessary to interfere 
with the signal. If the modulation of the jamming signal is 
different from the jammed signal, then the jamming signal 
acts as additional noise. If the type of signal modulation 
is known in advance, the jammer can be much more efficient 
with the same power level by matching this signal modulation. 
Consider a simplified ground-to-ground commvinications link 
as shown in Figure 1. 

Let 

Si = Transmitted Carrier Power Signal 

S = Received Carrier Power Signal 

Jl = Transmitted Jammer Power Signal 

J = Received Jammer Power Signal 

From Figure 1, the ratio, J/S , at the receiver determines 
the effectiveness of the jammer and whether or not it is 
successful in preventing recovery of the information signal 
at the receiver. The received power of the jammer, J, and 
the received power of the transmitter, S, are each determined 
by the original transmission power, Jl and Si, respectively, 
the distance of each to the receiver, and the gain of the 
antennas in use. 

The numerical result of the jamming-to-signal ratio, 

J/S, determines the amount of the information signal that is 
received correctly and the amount that is garbled. It is 
assumed that the garbling occurs on a random basis depending 
on this ratio. When the ratio is known, it can be equated 
to a probability of jamming on a bit by bit basis. In other 
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words, a specified J/S ratio at a receiver can be transformed 
into a probability that each, information bit is received 
correctly or incorrectly and hence a probability that any 
information bit is garbled or jammed. 

This probability of jamming (.P(.J)) is the basis for the 
continuous jamming portion of the computer model used in 
this experiment. The computer model reads a message file, 
translates each character into an eight bit code used in data 
transmission, and then garbles the bits serially based on a 
P(J). specified by the user. If the bit is garbled, it is 
switched from a 1 to a 0 or a 0 to a 1, otherwise the bit 
is left in its original state. Since the parameters affect- 
ing the J/S ratio at the receiver can vary so greatly, the 
probability of jamming was selected as the primary input for 
the computer model. Also it was thought that this would be 
much more useful and more applicable for follow-on applica- 
tions . 

The second type of jamming considered in this research, 
burst jamming, transmits a jamming signal in bursts instead 
of continuously. The jamming signal is transmitted for a 
time interval followed by an interval of no jamming. Like 
continuous jamming, it is most efficient when the jamming 
signal's modulation matches the jammed signal's modulation. 
Burst jamming allows the user to jam two or more signals 
with the same equipment by splitting his jamming time 
between each signal. It can, however, be used to jam a 
single signal . 
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The parameters of burst jamming are the same as con- 
tinuous jamming when the burst is "on". There is no effect 
on the jammed signal when the burst is "off". Therefore, 
when the burst jammer is "on", its effect on the received 
signal can also be transformed directly into a probability 
of jamming, or P(J) , and its effect on a serial bit stream 
can be calculated in the same, manner as with the continuous 
mode . 

The probability of jamming along with the time between 
each burst and the time duration of the burst are parameters 
used in the computer model to simulate burst jamming. The 
time between bursts and the time duration of the bursts are 
each expressed in units of information bits rather than in 
units of time. Again, due to the great differences in data 
transmission rates for equipment in the field, i.e. from say 
150 bits per second to 96QQ bits per second, and burst 
jamming equipment parameters, it was felt that a computer 
model that used the number of bits between each burst and 
the number of bits in each burst would be more useful for 
varied future applications. Therefore, given a rate of 
transmission, the burst length in units of time, and the 
time between bursts, an algebraic transformation can be 
made to a burst length in bits and time between bursts in 
bits. These parameters can then be entered into the 
computer program, along with a probability of jamming 
during the burst, to simulate the effect of a burst jammer 
on any given message. 
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E. COMPUTER MODEL TO SIMULATE JAMMING 



1 . Background 

The computer model simulates jamming a message based 
on the probability that an information bit will be garbled. 

As stated in the previous section, the transformation from 
a jamming-to-signal ratio to a probability of jamming can be 
made when one assumes that jamming occurs in a random fashion 
given a certain ratio level. Since information bits are 
transmitted serially over a data communications channel, the 
bits will be received serially either garbled or in their 
original state. The degree to which the received signal 
matches the transmitted signal depends upon the level of 
jamming. The higher the level of jamming, the greater the 
number of information bits that are garbled. A computer 
program that reads a message at the information bit level in 
a serial manner was deemed the optimum method to produce a 
"jammed" message. These "jammed" messages in the JINTACCS 
format and an all plain text with no format could then be 
used to perform an understandability experiment. 

2 . Methodology Of Computer Program 

The computer model simulates the two different 
types of electronic jamming selected for this experiment. 

The computer program is included as Appendix A and is 
written in FORTRAN. The data file containing the eight bit 
computer codes for each character are shown in Appendix B. 

The program was run on a PDP-11/70 in the Command, Control 
and Communications (C3) Lab at the Naval Postgraduate School. 
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The. program design is as shown in Figure 2. Explanatory 
comments are provided throughout the program for the reader. 

Basically, the computer program reads a message in 
a data file, translates each character in the message into 
its eight bit code of I's and O's, garbles or jams each bit 
based on the probability of jamming specified by the user, 
and then retranslates the garbled bits into whatever charac- 
ters they have now become. The eight bit code that was used 
is one parity bit and the seven bit ASCII code. The garbling 
or jamming of the information bits and hence, characters, is 
independent of the format of the message that is read into 
the computer program. The program just reads a file con- 
taining characters and spaces, garbles the file at the 
level according to the program's algorithm, and retranslates 
the bits back into characters. 

The program is written so that the user can specify 
either continuous or burst jamming. If continuous jamming 
is selected, the program then asks the user what probability 
of jamming to use. After P(J) is specified, the program 
then proceeds to read, garble, and print the "jammed" 
message. If burst jamming is selected, the program asks 
the user to specify three parameters: the niimber of bits 

between each burst, the length of the burst in bits, and 
the probability of jamming. After the user inputs his 
answers, the program again reads, garbles, and prints the 
"jammed" message. In the burst mode, the program jams the 
number of bits in the burst, skips the number of bits between 



25 



Computer Program 




Figure 2. COI^PUTIR PROGRAM DESIGN 
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bursts, and then repeats the process. So the bursts can be 
very far apart or they can be close enough to approach the 
continuous jamming case. 

The program is written so that any nximber of messages 
can be processed from a file. The messages must be separated 
by a in the first column of the line separating the end 

of one message and the beginning of the next. In this manner, 
the program will keep reading messages until it reaches the 
end of the file. There is no special character to denote the 
end of file; the program stops after the last line of the 
last message. A sample input showing a file containing two 
messages, one JINTACCS and one plain text, is shown in 
Appendix C. A sample output file of these same messages 
after continuous jamming with P(J) = 0.01 (1.0%) is shown 
in Appendix D. A sample output file using burst jamming 
with 100 bits between each burst, a 25 bit burst length and 
P(J) = 0.10 (10.0%) is shown in Appendix E. It is then a 
simple matter to send the output file to a printer to obtain 
a hard copy of the jammed messages. 

3 . Artificiality Of The Mode l 

Any simulation model should reflect reality as 
accurately as possible or feasible. The further the model 
is from reality or the more limitations the model has, the 
less credibility it has as a model. As long as the user is 
aware of a model's limitations, and the limitations are not 
too severe, the model can still be a very useful tool. The 
computer model to simulate continuous and burst jamming for 
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this experiment has four limitations that the reader 
should be aware of. 

The first constraint of the computer model is that 
carriage returns and line feeds were not allowed to be 
jammed. The model reads and garbles a line of text after 
it has determined the last non-space character in the line. 

It then reads the next line of text, finds the last character 
in the line, proceeds to garble that line, and the process 
is repeated until it reaches the end of the message. If the 
model were to include the carriage return in the jamming 
process, the model could end up printing one line over 
another if the carriage return were garbled. If all the 
carriage returns in a message were garbled, a twenty line 
message would have all twenty lines printed on the first 
line of the output file. This over-printing would obviously 
be useless to try to decipher and it would not matter whether 
the characters had been garbled or not. This over-printing 
problem, although it would happen in reality, was therefore 
not considered useful to include in the model. The purpose 
of the jamming is to see if one message format is more 
understandable than another given the same amount of charac- 
ter garbling on each. If all the lines were over-printed, 
there would be no way to differentiate the two message 
formats . 

The second constraint of the model is the number 
of characters that were included in the computer program's 
translation table . The table is shown in Appendix B and 
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the reader will note that only capital letters were used. 

This is realistic since the teletype equipment used by the 
military to process messages uses only capital letters. 

The limitation is that there are more special characters in 
the table than are available on a standard tactical military 
teletype keyboard. With, the advent of optical character 
readers that use the IBM Selectric character set found in 
many fixed base military communications centers, the charac- 
ter sets are almost the same. However, the fact remains 
that for the tactical environment in which JINTACCS will be 
used, the number of characters available is less than that 
shown in the model. This limitation is considered minor 
when one considers that once one or more of the bits in a 
character are garbled, the character is retranslated into 
whatever character it has now become. It does not really 
matter which new character is printed. In other words, 
once a character is translated from its original state, it 
does not matter what character is now printed because one has 
no clue as to what the character was. The job of trying to 
decipher and understand the jammed message is the same 
regardless of the character set used. 

The third limitation is also considered a minor one. 
The model is written such, that after the bits in a character 
are garbled, it searches the data table to see what character 
the bits have now become. If it does not find a character 
match, the model prints a space for that character. The 
selection of a space for an unknown character was purely an 
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arbitrary selection. The selection had to be made because 
it was and is unknown as to what a printer would print if 
the bits do not match any known character. There is the 
additional problem of the possibility that the bits might 
be translated into a control character of some type that 
affects machine processing or the printer itself. This could 
have a disastrous effect on a printer if it occurred. The 
selection of the space character for an unknown character 
seemed proper, therefore, and this constraint was considered 
minor in light of the overall need to produce jammed messages 
for the experiment. 

The fourth and final limitation of the computer model 
is the exclusion of any kind of coding for bit error detection 
and correction. Coding is one of the techniques available to 
overcome jamming. It is the addition of one or more extra 
bits after so many information bits to provide a parity check 
on the previous information bits. These extra check bits are 
redundant since they carry no additional information other 
than the check data. Many modern data communications systems 
take advantage of bit error correction codes to provide for 
the automatic identification and correction of any trans- 
mission errors introduced into the system. The use of these 
avoids the need for retransmission of a message since the 
errors can be detected and corrected at the receiver. There- 
fore time is saved in communicating a message, and the 
communications channel is conserved by transmitting each 
piece of information one time only. Two types of bit error 
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detection and correction codes that could be used are the 
Hamming code and the Bose, Claudhuri and Hocquergem or BCH 
code. If a type of coding had been considered in the model, 
it would have been able to detect and correct errors intro- 
duced by the jamming up to a certain point. Beyond that 
point, that is, after so many errors had been introduced, 
the coding would not be able to correct them. For example, 
using a Hamming (7,4) code, there are 4 information bits 
and 3 check bits for a total of 7 bits per codeword [Ref . 15]. 
This Hamming (7,4) code will detect and correct 1 error in 
the 7 bits, which can be equated to a probability of jamming 
of 1/7 or about 14.3%. Therefore, this code could overcome 
up to a 14.3% rate of jamming; beyond that it could do no 
good. Since the type of coding in use varies, the level or 
amount of jamming each code could overcome can be calculated 
fairly easily and the appropriate level of jamming can then 
be selected for the model. For these reasons, a bit error 
detection and correction code was not selected nor used in 
the computer model. 

F. SUMMARY 

The purpose of this thesis is to investigate the suscep- 
tibility of the JINTACCS message format to electronic jamming. 
The investigation consists of an experiment that compares the 
under standability of the JINTACCS message format to a plain 
text message format given equal amounts of jamming to each. 

The need for this research arises from the fact that the 
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JINTACCS message standards are in the development stage and 
are due for implementation by all services in 1985. In 
addition, electronic jamming of our tactical data communi- 
cations is more of a possibility in today's world. It is 
therefore critical to know that these new JINTACCS message 
formats are at least as effective in communicating informa- 
tion in a jamming environment as a plain text non-formatted 
message. In the joint tactical environment, communicating 
and understanding critical information between force elements 
directly affects mission success. We need to verify that we 
are not adversely affecting our capability to succeed. 

The object of this research is to provide a realis- 
tic test of the under standability of one type of JINTACCS 
message format applicable to Air Force operations. It is 
hoped that this research effort will provide valuable 
information to both Air Force and other service decision 
makers that would otherwise not be available. 
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II. DESCRIPTION OF THE EXPERIMENT 



A. OBJECTIVES AND CONSTRAINTS 

The object of this experiment is to compare the effec- 
tiveness of the JINTACCS message format to a plain text 
message format in an environment subjected to a certain amount 
of jamming. Effectiveness is measured as a subjective rating 
of the degree of understandability of those pieces of criti- 
cal information contained in each message. The critical 
information in one message, format may not be in the same 
field or fields as in another message format so that the 
effectiveness rating considers the entire message. Speci- 
fically, the experiment was designed to determine if there 
was any significant difference in understandability between 
JINTACCS formatted messages and plain text non-formatted 
messages after each had been subjected to equal levels of 
two types of jamming. 

•The experiment was constrained by the facilities avail- 
able to the Tactical Air Forces Interoperability Group 
(TAFIG) at Langley AFB , Virginia, and the C3 Laboratory at 
the Naval Postgraduate School (NPS) . 

B . SUBJECTS 

Two groups of subjects were used for the experiment. A 
pilot trial was conducted at NPS using student volunteers. 

The main experiment was conducted at Langley AFB with a 
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second group of military subjects on a temporary duty 
training to use JINTACCS . 

The pilot trial group consisted of 16 military officers 
representing the Air Force (.9)., Army (4) , and Navy (3) . The 
officers included 15 males and 1 female. Their grades ranged 
from Captain to Major and Lieutenant to Lieutenant Commander. 
The subjects ' ages ranged from 29 to 39 with an average age 
of 33. Their length of service varied from 6 years to 14 
years with an average length of military service of 9.5 
years. All of the sxibjects in the pilot trial were enrolled 
in the Command, Control and Communications Curricula at NFS. 
Their backgrounds were quite varied including communications, 
missile combat crew commander, computers, weapons control, 
electronic warfare, navigation, artillery, infantry, surface 
warfare, and naval flight. 

The second group of subjects at Langley AFB consisted of 
25 military officers representing the Air Force (18) , Navy 
(2) , Marines (1) , Air National Guard (3) , and Air Force 
Reserves (,1) . There were 24 males and 1 female. Their 
grades ranged from 2nd Lieutenant to Lieutenant Colonel and 
Lieutenant to Lieutenant Commander. The subjects' ages 
ranged from 24 to 44 with an average age of 31 years old. 
Their length of service varied from 2 years to 22 years 
with an average of 11 years of military service. The back- 
grounds of the subjects in the second group also varied 
widely. 
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Th.e second group of subjects were on temporary duty 
(TDY), at Langley AFB to receive. JAMPS training and to then 
participate in an Air Operations Interoperability Test of 
the JINTACCS message standards. The subjects' experience 
in their operational facility ranged from no experience to 
six years and no exercise participation to approximately 20 
exercises. Only a handful of the subjects had JAMPS training 
prior to this experiment, so the majority were seeing JAMPS 
for the first time and were in the initial training mode. 

C . EQUIPMENT 

1. JAMPS Terminal 

The computer system at Langley AFB that was used for 
this experiment consisted of numerous terminals connected to 
a Digital Equipment Corporation (DEC) PDP-11/70 computer. 

The computer terminals were Perkin-Elmer Owl 1200 's, which 
are the standard view screen and keyboard terminals common 
today. Their display is a 12 -inch diagonal inverse video 
(white-on-black or black -on -white), cathode ray tube (CRT) 

[Ref. 17]. The keyboard is fixed-alphanumeric with 16 
(shiftable to 32) functional control keys and 6 additional 
function keys collocated with alphanumeric keys [Ref. 18]. 

The terminal can display 24 lines with 80 characters per 
line . 

The keyboard of the JAMPS terminal is divided into 
two basic groups, alphanumeric keys and function keys. The 
alphanumeric keys are used by the JAMPS operators to create 
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and enter the data for any or all fields of a JINTACCS- 
formatted message [Ref. 19] . They are like those keys on 
a standard typewriter keyboard. The function keys are used 
for editing, verification and transmission of the various 
JINTACCS -formatted messages [Ref. 20]. These keys are 
color coded and dual action, requiring upper and lower case 
operation . 

2 . JAMPS Operation 

The operation of the JAMPS terminal is fairly 
straightforward. After the operator is logged on, he simply 
types 'JAMPS' to initiate the JAMPS program. A menu showing 
a category selection list appears on the display and the 
operator can choose the type of action he wants to accomplish 
(see Figure 3) . The operator can choose one of six different 
types of message formats, messages that have been saved, a 
transmitted message file, a received message file, or he can 
quit. 

If the operator chooses one of the six types of 
JINTACCS messages, he is then presented with a submenu 
display of all the available messages within the desired 
category. An example of a partial submenu display for Air 
Operations messages is shown in Figure 4 . 

From this submenu, the operator chooses the message 
number of the desired message, and the blank message tem- 
plate is displayed. An example of the blank message tem- 
plate for number A650 or Apportionment/Allotment Message 
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Eigure 3. JAMPS CATEGORY SELECTION MENU DISPLAY 
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AIROPS 



UNCLASSIFISB 



00AIRO AIROPS — 



r^SG-NO 


MESSAGE TITLE 


F541 


Acknowledge Message (AKNLDGj 


S710 


Air Defense Command Message [ARDEFCOM] 


2715 


Air Defense Warning Message [AIRDEFWARN] 


A651 


Air Empl oyment /Ai locat ion Plan [EMPLOYALOCj 


A661 


Air Mission Request Status/Tasking Message [RECSTSTSK] 


B704 


Airbase Change Report [ABCEAMGE] 


F631 


Airlift Mission Schedule fALMSNSCD] 


D630 


Airlift Request [ALRECj 


B705 


Alert Aircreft/SAM Status Report [ACSAMSTAT] 


A770 


Alert Launch Order [ALORDj 


Ac50 


Appcrtionment/Allctment Message [APORALOT] 


F654 


Cross-Force Mission Data Conf i rm^ati on Message LCROSSCONF] 


A653 


Cross-iorce Mission Data Message [CROSSDATJ 


F750 


Designated Area Message IDESIGAREA] 


F751 


ECM Data Message [SCMDATJ 


B711 


Engagement Status [ENGSTS] 


F632 


Flight Control Information Message [FLTCONTINEO] 



Figure 4. JAMPS AIR CPSRATIONS SUEr^ENU (Not Complete) 
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(APORALOT) , which is an air operations message format, is 
shown in Figure 5 . 

The operator can then compose and type his message. 

He can fill in the blanks in the format shell or "mask" mode 
or he can select either a "help" mode or a "conversation" 
mode which will assist him in filling in the complete message. 
The mask mode is designed for the more experienced JAMPS 
operator. The help mode allows the experienced operator to 
review the meaning of a single field or the type of data to 
be entered in that field. The operator can jump back and 
forth between the mask and help modes. The conversational 
mode is designed to provide detailed instruction to the 
novice user by guiding the operator through the message in 
a field-by-field manner [Ref. 21] . 

D. MESSAGES USED FOR THE EXPERIMENT 

As stated previously, there are six categories of 
JINTACCS messages. These are administrative, air operations, 
operations control, intelligence, fire support, and amphib- 
ious. Since the test subjects were at Langley AFB for an 
Air Operations Interoperability Test, the air operations 
messages were chosen for this experiment. An alphabetical 
list of the JINTACCS air operations messages as of 30 July 
1981 is shown in Appendix F [Ref. 22]. For the experiment, 
the following air operations messages were used: acknowledge 
message, airlift request, search and rescue incident report, 
airbase change report, message change report, sortie allotment 
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A650Gi^lA xxxxxxxxxxxxxx 



Z0A650 A650G01A 



iROM/PLA: /RI: 

/ADDR: 

/PRIPREC: _ /SECPREC: _ /ETG : // 

TC/PLA; /RI: 

/AEDR: 

INiO/PLA: /RI: 

/ACER: 

CLASS/CLAS: UNCLAS 

/DESIGNATOR: // 

SIC/SIE-CODE: ___ // 

EXER /EXERCISE: 



/CLASS : 



// 

// 



/EXER-AEE: // 

OPER/OPERATION NAME: 

/OPLNNO: /OPT-NICKNAME : 

/SEC-OPT-NICKNAME: // 

MSGIE/MSG-TIILE: APORALCT /MSG-ORIG: 

/rSG-SEH-NUM: /NNTHNM: /CLP: /SEHNUM: // 

REE/MSG-TITLE : /MSG-CRIG: 

/EATE-I IME-RSF: /MNTHNM: /MSG-SER-NUM : /SIC: 

/SPEC-NOT: // 



Figure 5. JINTACCS APPCRT lONMSNT/ALLCTMENT (APORALCT) 
ELANE MESSAGE TEMPLATE DISPLAY 
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message, alert aircraft/SAM status report, cross force 
mission data message, request confirmation message, flight 
control information, and request status task message. 

The messages used for the experiment were made up with 
the same information in each format. For example, an airlift 
request message was made up using the proper JINTACCS message 
format. It is shown in Figure 6. The same information was 
then rewritten in a plain text or plain English message, as 
shown in Figure 7. In this manner, each message contained 
exactly the same critical information but was packaged 
differently. Specific questions could be asked of a test 
subject to determine the amount of critical information the 
subject could extract, given equal levels of garbling to 
each message type. 

E. EXPERIMENTAL PROCEDURE 

1 . Conduct Of The Experiment 

The experiments were conducted in two phases; pilot 
trials at NPS and main experiment trials at Langley AFB . 

The procedures used for each are described separately below. 

For the pilot trials, the subjects were given indi- 
vidual message packets to complete. Each packet contained 
five plain text messages that had been garbled at different 
levels of continuous and burst jamming. No JINTACCS messages 
were included in these pilot trial packets since the subjects 
had received no JINTACCS training nor was any JINTACCS 
material available for their use. Each packet was arranged 
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FFOM/ABCCl/RUJ lAAt/ABCCC LANGLiY AFB V A/U / 0/ 0/ Ib'^fdbbZ OCT 61// 
TO/JTF-JTBI/RUJICAD/JTF JTB IT MONHOUTH NJ// 

TO AF-TACCI/RUJIAAB/AF TACC LANGLEY AFB VA// 
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OPER/BTU CERTIFICATION// 
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Figure 6. SAhPLE JINTACCS AIHLIM' HEQUEBT MESSAGE 
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Fife;ure V. 3AhPU PLAIN TEXT AIRLIFT REQUEST MESSAGE 



so that it contained five seta of garbled messages and 
questionnaires on the critical pieces of information. The 
questionnaire for a message immediately followed each 
message. The questionnaire had from 6 to 19 short answer 
f ill-in-the-blank questions. The questions were worded to 
minimize the possibility of leading the subject or helping 
him deduce the answer from the garbled message or from the 
Other questions. A sample questionnaire used for the 
airlift request message is shown in Figure 8. 

The subjects were given instruction sheets stapled 
to the front of the packet. They were told that the reason 
for conducting this experiment was to determine the under- 
standability of these messages at various levels of jamming. 
Their responses would be examined to estimate how message 
under standability is affected by jamming. They did not know 
how much jamming each message had been subjected to, nor did 
they know which type of jamming had been used on any message 
The instruction sheet explained that the messages in the 
packet had been garbled by a computer model that simulates 
electronic jamming. The sheet instructed them to do two 
things. First they were to read the message and correct any 
garbled letters as best they could by writing the correct 
letters above the bad ones. It was felt that by correcting 
the garbled letters, they would be forced to work more to 
decipher the garbled message and understand it. Secondly, 
the subjects were instructed to answer the questions concern 
ing each message to the best of their ability. 
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I. WHAT TYPE OF MESSAGE IS THIS? 

H. WHAT IS THE FIRST ACTION CITED BY THIS MESSAGE? 

3. HOW MANY AIRCRAFT ARE REQUESTED? u_ 

4. WHAT KIND OF AIRCRAFT ARE REQUESTED? 

5. WHERE WILL THE AIRCRAFT BE UNLOADED? ___> 

6. WHAT KIND OF CARGO IS BEING UNLOADED? 

7. WHAT IS THE HAZARD TYPE OF THE CARGO BEING ONLOADED? 

£. IS 'single dagger" REQUIRED? YES NO 

y. WHERE WILL THE AIRCRAFT BE OiiLOADED? _j ‘ 

IZ. WHAT FREQUENCY IS TO BE USED PRIOR TO LANDING? 

II. WHAT SPECIAL EQUIPMENT IS REQUIRED? 



Figure 8. SAMPLE QUESTIONNAIRE FOR AIRLIFT REQUEST MESSAGE 
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The intent of the pilot trials was to determine the 
amounts of continuous and burst jamming that should be used 
for the main experiment. If too little jamming were used, 
it was felt that no difference in understandability would 
result. Likewise if too much jamming were used, both message 
types would be so garbled that neither would be understandable 
and again there would be no difference between JINTACCS and 
plain text messages. If any difference in understandability 
between the two message types exists, it was believed that 
the difference would be most noticeable at that point just 
before all understandability decreases rapidly. It was 
hypothesized that a plot of understandability versus the 
amount of jamming would result in curves like those in 
Figure 9 for continuous and burst jamming. The amount of 
jamming used for the main experiments should therefore be in 
the vicinity of the asterisks marked on the two plots. 

The experimental procedure was essentially the same 
for the main experiment at Langley AFB with the second group 
of subjects. They were told that the experiment was being 
conducted to determine if there was any significant difference 
in understandability between JINTACCS messages and messages 
that were written in plain text given an equal amount of 
garbling or jamming to each. Each subject was given a packet 
containing six JINTACCS messages and six plain text messages 
and each group of six messages was labeled. The subjects 
were instructed to correct the garbled letters as best they 
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could by writing the correct letters above the bad ones for 
each message and to answer the questions for each message to 
the best of their ability. The instruction sheet is shown 
in Appendix G. 

The subjects at Langley AFB were allowed to use the 
JAMPS computer terminals to aid in deciphering the JINTACCS 
group of messages in their packet. In this manner, if they 
could determine what type of message they were working on, 
they could select that format on the JAMPS terminal and have 
the blank format displayed. With the display they then knew 
what type of information was supposed to be in each field. 
This should enhance their ability to decipher the JINTACCS 
messages. When working on the plain text messages, the 
subjects had no computer aids to help in deciphering the 
garbled messages. The amount of jamming used in the main 
experiment was determined from the pilot trials at NPS. 

The subjects were given a time limit to add some 
realism to their tasks. They were allowed 60 minutes per 
message group or an average of 10 minutes per message. The 
time pressure, although artificial, was an attempt to provide 
a surrogate for the pressure a subject might encounter in a 
tactically deployed battlefield environment. However, since 
it was important for the subjects to finish the messages, 
and since they were not being tested for speed, the subjects 
who were not done in 60 minutes were allowed to finish. 

They did not know in advance that they would be given extra 
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time to finish. Only a few took- longer than the alio ted 
time . 

2 . Experiment Description 

The overall experiment can be divided into basically 
three separate sub-exper iments . The first sub-experiment 
was conducted at NPS and there were two trials, called the 
pilot trials. Pilot trial 1 used plain text messages with 
continuous jamming at 0.5%, l.Q%, 1.5%, 2.0%, 2.5%, 3.0%, 
3.5%, 4.0%, 4.5% and 5.0% (the values represent the proba- 
bility of garbling an individual bit) . Pilot trial 2 used 
plain text messages with two types of burst jamming at the 
1.0%, 3.0%, 5.0%, 7.0%, 10.0% and 20.0% levels. 

TKe second sub-exper iment was conducted at Langley 
AFB and there were three trials. Trail 1 was the control 
group; each subject had JINTACCS and plain text messages 
with no jamming. These trials were used to determine if 
there were differences in understandability due to the type 
of format even if no jamming were applied. Trial 2 was the 
test of JINTACCS versus plain text at the 1.0% level of 
continuous jamming, at the 5.0% level of burst jamming with 
100 bits between bursts and 25 bits in the burst, and at the 
5.0% level of burst jamming with 200 bits between bursts 
and 50 bits in the burst. Trial 3 was conducted to estimate 
the understandability curves for JINTACCS messages. It 
tested continuous jamming from the 0.5% to 3.0% levels, 
burst jamming with 100 bits between bursts, 25 bits in the 
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burst, and from 3.0% to 20. Q% levels of jamming, and burst 
jamming with 200 bits between bursts, 50 bits in the burst, 
and from 3.0% to 20.0% levels of jamming. 

The third sub -experiment was also conducted at 
Langley AFB and was essentially a follow-up test for the 
second sub-experiment. There were, two reasons for this 
third sub-experiment. First, the majority of test subjects 
had received minimal training (one and a half days) before 
the second sub-experiment. Any differences between JINTACCS 
and the plain text messages might not be directly attributable 
to the differences in formats and could be of questionable 
validity because of the limited training. Secondly, the 
third sub-experiment enabled us to estimate the understand- 
ability curves for both JINTACCS and plain text from the same 
test group. The first sub-experiment provided estimates of 
the understandability curves for plain text messages; the 
second sub-experiment was used to estimate the JINTACCS 
understandability curves. However, there was no information 
that would enable us to directly compare the message formats 
because the groups were different. 

There were no control group trials in the third 
sub-experiment. Trial 2 was repeated but with the addition 
of continuous jamming at the 2.0% level. Trial 2 therefore 
provided comparison tests for two types of continuous jamming 
and two types of burst jamming. Trial 3 was a replication of 
trial 3 in the second sub-experiment, but both JINTACCS and 
plain text messages were used. 
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F. SUBJECT QUESTIONNAIRE 



An 11 item siibjective questionnaire was given to each 
experimental subject at Langley AFB. after the subject had 
completed his message packet. The purpose of the question- 
naire was to determine the subjects ' attitudes about the 
JINTACCS message format. The questionnaire is shown in 
Appendix H and is annotated with the average response to 
each question from each sub-experiment. The direction of 
the shift from the first to the second sub -experiments is 
annotated with arrows, ->■ or , 

G. DEPENDENT VARIABLES 

The measure, % understandability , was estimated for each 
trial as follows: 



N 

TC . 

1 

% Understandability = — x 100 

N 

E™. 

i = 1 



where TC = Total Questions Answered Correctly 
Per Subject Response 

TQ = Total Questions Per Subject Response 
N = Total Number of Subjects 
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H. HYPOTHESES 



The following null hypotheses regarding understandability 
were tested; 

1. Hypotheses Regarding Understandability 
TaII Sample ResultsT 

For each category of continuous and burst jamming: 

(a) Ho: There is no difference in the percent of 

understandability between JINTACCS and plain text messages 
given continuous jamming at the 1.0% and 2.0% levels. 

(b) Ho; There is no difference in the percent of 
understandability between JINTACCS and plain text messages 
given burst jamming at the 5.0%, 7.5% and 10.0% levels. 

(c) Ho; There is no difference in the percent of 
understandability between JINTACCS and plain text messages 
given no jamming. 

2 . Hypotheses Regarding Understandability 

(Middle Results Only), 

After the initial analysis of the data, the plain 
text scores seemed to be grouped closer together while 
the JINTACCS scores had a greater dispersion with some 
scores which seemed to be outliers on the low side. In 
order to determine if the effect of the few outliers was 
sufficient to alter the conclusions of the statistical 
tests the upper and lower scores were trimmed from the 
data sets and the tests were repeated using only the 
middle 50.0% of the scores. Therefore, to determine if 
there is a difference in percent of understandability 
when the top and bottom scores are discarded, the 
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following hypothesis tests were conducted for each 
category of continuous and burst jamming. 

(a) Ho: There is no difference in the percent 

of understandability between JINTACCS and plain text 
messages given continuous jamming at the 1.0% and 

2.0% levels. 

(b) Ho: There is no difference in the percent 

of understandability between JINTACCS and plain text 
messages given burst jamming at the 5.0%, 7.5% and 
10.0% levels. 

I. EXPERIMENTAL DESIGN 

The experiment was designed as shown in Figure 10. The 
message packets were made up to include two groups of six 
messages each. The subjects were divided so that one half 
would start on the JINTACCS message group while the other 
half started on the plain text message group. This would 
insure neither message type received favorable treatment by 
being first or second all the time. Each subject received 
the same 12 messages, but the messages were presented in a 
randomized order. Each of the 12 messages was distinct with 
its own information. In addition, no subject saw a JINTACCS 
message and then saw that same message in a plain text format 
in his packet. The messages were balanced so they appeared 
in the different packets the same approximate number of times 
in the JINTACCS and plain text formats. As a result of the 
above, no two packets were exactly alike. While the subjects 
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Figure 10. CONCEPTUAL EXPERIf^ENTAL DESIGN 
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sat next to each other using the JAMPS terminals for the 
JINTACCS messages, each subject worked on different messages. 



J. RESULTS 



The experimental results for the understandability of 
JINTACCS and plain text messages are presented in this sec- 
tion. The hypothesis tests for each type of jamming were 
done by comparing the two sample proportions. The test 
statistic is [Ref. 23] : 

2 = (P^ - P2)./ap 

p^ = Plain Text Proportion 
P 2 = JINTACCS Proportion 



where 



and 

where 



’p = 



(1 - p) 



(ni + n2) 
ni . n2 



n^ = Number of Plain Text Samples 
n 2 = Number of JINTACCS Samples 



n 



P = 



1 • Pi 



+ n. 



"1 "2 



Using a significance level of a= 0.10, the test would 
fail to reject the null hypothesis if -1.645 < z < 1.645 
and would reject the null hypothesis if the 2 value fell 
outside this interval. 

1 . Results For Understandability (All Sample Results). 

The experimental results for the percent of under- 
standability of JINTACCS and plain text messages using all 
of the sample results for the first hypothesis tests are 
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shown in Table I. Both sub -experiments failed to reject 
the hypothesis in every case, implying no significant 
difference in under standability exists for the two formats. 
Because it appeared from the understandability curves at the 
various levels of jamming that the plain text scores consis- 
tently dominated the JINTACCS scores, a Mann -Whitney U test 
was conducted to do a rank comparison of the results [Ref. 

24J. This is one of the more powerful nonparametric tests 
and is used to determine whether two independent groups have 
been drawn from the same population [Ref. 25]. It is a most 
useful alternative to the parametric t test but it does not 
require any of the t test's assumptions about the populations' 
distributions nor their variances [Ref. 26]. The test sta- 
tistic is based on the rank order from the lowest to the 
highest scores and it might give different results from the 
proportion test if the one set of scores consistently outrank 
the others, even though their averages may be close together. 
The result for this test also failed to reject the null 
hypothesis that there was no difference in understandability 
between JINTACCS and plain text messages, except for the 
continuous 1.0% case from sub-experiment 2 trial 2. 

2 . Results For Understandability (Middle Results Only) 

The experimental results for the percent of under- 
standability of JINTACCS and plain text messages using only 
the middle 50% of the sample results for the second hypo- 
thesis tests are shown in Table II. These tests were run 
to see if perhaps there is a difference when the upper and 
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TABLE 1 



RESULTS EOR UNLEfiSTANDAB IL I TY (ALL RESULTS) 



Type Of Jamming 1 JINTACCS I Plain Text 1 Z Value 





1 1 
1 1 




1 


Sut-Experiment 2 


Trial 1 








1 1 
1 1 




1 ^ 


^ No Jarrnning 


i 95.8Z% ! 


96.57% 


1 0.12 (NS ) 


^ (Control Group) 


1 1 
1 1 




{ ^ 


5? 


i 1 

1 1 




1 ^ 



Sub 


-Experiment 2 Triai 2 

1 


1 




1 




Continuous 1.0% 


1 

1 69.2% 


1 

1 

1 


79.4% 


1 

1 0.95 (NS) 




Burst 100 25 5.0% 


1 76.9% 


1 

1 


82. S% 


1 0.42 (NS) 




Burst 200 50 5.0% 


1 69.6% 

1 


1 

1 

1 


83.9% 


! 0.97(NS) 
1 


Sub 

3? 


1 

-Experiment 3 Triai 2 

i 


1 




1 

1 


n* 


Continuous 1.0% 


1 

I ei.42% 


1 

1 

1 


61.45% 


1 

1 .002 (NS) 


3r 


Continuous 2.0% 


1 55.65% 


1 

1 


69. 12% 


i 0.74 (NS) 




Burst 100 25 7.5% 


1 77.27% 


1 

1 


60.6% 


1 0.22(NS) 




Burst 200 50 10.0% 


i 70.54% 


1 

1 


70 . 0% 


1-0. 02 (NS ) 



NS = Not Significant 
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TABLE II 



RESULTS EGR UNDERSTANUABILITY (MIDDLE RESULTS) 





Type Of Jarrrring 


1 

1 


JINTACCS 


! Plain Text 


! Z Value 




5? 




i 

1 




1 

1 


1 

1 




Sut) 


-Experiment 2 


Trial 


2 








?r 


- 


i 

1 












Continuous 1.0% 


1 

1 






! 






Upper 


1 

1 


93. y% 


95.8% 








Middle 50% 


1 


72.5% 


81.1% 


i 0.59(NS) 






Lower 25% 


i 

1 


48.0% 


59.5% 








Burst 100 25 5. 


0% ; 










n' 


Upper 25% 


1 


90 .9% 


100.0% 






n' 


Middle 50% 


1 

1 


79.1% 


82.3% 


! 0.17(NS) 






Lower 25% 


1 


58.8% 


68 .8% 







- Burst 2GG 5G 5.G% 





Upper 25% 


1 93 .c% 


1 

1 


100.0% 


1 

1 






Middle 50% 


i 71.4% 


1 

1 


81.7% 


1 

1 


0.50(NS) - 




Lower 25% 


1 'X 

) ^ o • f 


1 

1 


70 . 0% 


1 

1 




>r 




i 


1 

1 




1 

1 





NS = Not SijeniTicant 



(CONTINUED ON NEXT PAGE) 
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lAi3LE II (CONTINUED) 



RESULTS FCH UNDERSTANDAL IL I TY (hlDDlE RESULTS) 



Type or JamiTing i JINTACCS ! Plain Text I Z Value 







1 




1 

1 




1 

1 




Sub 


-Experiment '6 Trial 


c. 












Continuous 1.43% 


j 

1 




1 

1 




1 

1 






Upper Z£% 


I 

1 


95.7% 


1 

1 


93.1% 


1 

1 






l^iddle 50% 


1 

1 


£1.5% 


1 

1 


83.6% 


1 0.10(NS) 






Lower 4f5% 


1 

1 


6£.0% 


1 

1 


67.7% 


1 

1 






Continuous 2.0% 


1 

1 




1 

1 




1 

1 






Upper 25% 


1 

1 


87.5% 


1 

1 


90.5% 


1 

1 


3r 


'if* 


Middle 50% 


1 

1 


55.6% 


i 

1 


69.7% 


1 0.58(NS) 




3r 


Lower 25% 


1 

1 


21.7% 


1 

1 


50 . 0% 


1 

1 


5? 




Burst 100 25 7.5% 


1 

1 




1 

1 




1 

1 


5? 




Upper 25% 


1 

1 


91 .9% 


1 

1 


96.9% 


1 

1 






Middle 50% 


1 

1 


76.7% 


1 

1 


83.3% 


1 0.3KNS) 




'I* 


Lower 25% 


i 

1 


62 . 9% 


1 

1 


60 . 6% 


i 






Burst 200 50 10.0% 


1 

1 




i 

1 




1 

1 






Upper 25% 


1 

1 


£6.4% 


1 

1 


91.3% 


1 

1 






Midaie 50% 


i 

1 


70.3% 


1 

1 


69 . 6% 


1 -0 •03(NS ) 






Lower 25% 


1 

1 


54.5% 


1 

1 


53 . 6% 


1 

1 





NS = Net Significant 
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lower scores are discarded. Again both sub-experiments 
failed to reject the hypothesis in every case, implying no 
significant difference in understandability exists for the 
two formats. 

3 . Results For Continuous Jamming (JINTACCS Versus 

Plain Text) 

Although the plots of percentage of understandability 
versus jamming percentage generally follow the hypothesized 
continuous jamming curve shown in Figure 9, there are some 
features of the curves unexpected by the experiment. A plot 
of the percent of correct answers versus the amount of con- 
tinuous jamming is shown in Figure 11. The plain text results 
are from the pilot trials at NPS and the JINTACCS results are 
from sub-experiment 2 at Langley AFB. A plot of their dif- 
ferences at each level of jamming is shown in Figure 12. As 
can be seen from these plots, the plain text scores were 
higher at almost all levels of jamming. However, since the 
results for plain text were from a different group of test 
subjects than the JINTACCS results, no firm conclusions can 
be drawn . 

The plot of the results from sub -experiment 3, where 
all responses are from the same test subjects, showed even 
more intriguing results. The plot of the two curves is 
shown in Figure 13 and the plot of the difference curve is 
shown in Figure 14 . As the reader can see from these plots , 
the plain text results were more understandable with light 
jamming but, at higher levels of jamming (>1.5%) , JINTACCS 
messages were more understandable. A possible reason for 
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Figure 14. PLOT OF CONTINUOUS DIFFERENCE CURVE (SECOND PART) 
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this change from the earlier experiment is the amount of 
training the subjects had received. By the time of the 
third sub-experiment, the subjects had received a significant 
amount of training since the second sub-experiment. The 
additional training and familiarity with the JINTACCS format 
and the JAMPS computer terminals and the JINTACCS format 
itself might account for their ability to recover more infor- 
mation given an increased amount of jamming. 

A plot of all four results on the same graph is 
shown in Figure 15 for the reader's review. 

4 . Results For Burst Jamming (JINTACCS Versus 

Plain Text) 

The results for the burst jamming mode in sub- 
experiment 1 (the pilot trials at NPS) are shown in Figure 
16. The parameters selected for the burst jamming are shown 
in the figure. As can be seen from the figure, the resulting 
curves are relatively flat, implying that within the range 
of values selected for the burst parameters, understandability 
was not very sensitive to the percentage of jamming. As a 
consequence, different parameters were chosen for the main 
experiment. The burst results for sub -experiment 2 are 
shown in Figure 17. As can be seen from these plots, the 
results are again fairly level. The results for the burst 
jamming trials in sub-experiment 3 are shown in Figure 18. 

A plot of the two difference curves is shown in Figure 19. 

As can be seen from these figures, the curves have a steeper 
slope than the pilot trial results in Figure 16, looking 
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rnFERENCE CURVE (PLAIN TEXT - JINTACCS) 
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more like what we expected to see. Note also that the 
difference curves in this case are not at all similar to 
each other and they do differ from the continuous jamming 
results curve shown in Figure 14. As the size of the burst 
increases and the number of bits between bursts decrease, one 
would expect the burst results to approach that of the 
continuous results. 

5 . Results For Subject Attitudes 

The subjective questionnaires given after sub- 
experiment 2 and sub-experiment 3 at Langley AFB were scored 
and an average computed for each question. These averages 
along with the questions are shown in Appendix I. A shift 
in attitudes in almost all questions was noted and the shift 
was from favoring plain text messages to being either neutral 
or favoring JINTACCS messages. It is apparent that the time 
the subjects spent between sub-experiments training on the 
JINTACCS formats tended to build their confidence in the 
JINTACCS format. 
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III. CONCLUSIONS 



This thesis sought to determine if there was any signif- 
icant difference in understandability between the JINTACCS 
message formats and plain text messages when an equal amount 
of jamming is applied to both message types. It also sought 
to estimate the understandability curves for each message 
type for a range of levels of jamming for two types of 
jamming. A computer program was written to simulate the 
effect of continuous and burst jamming, and experiments were 
conducted for this research. 

The comparison of JINTACCS to plain text for understand- 
ability revealed no statistically significant differences. 
Although the plain text scores were generally higher than 
the JINTACCS scores in the first comparison test, the 
differences were not large enough to be significant with the 
size of the samples that we had. The scores in the second 
comparison test after the subjects had received more training 
with JINTACCS showed even less differences in the understand- 
ability of plain text messages and JINTACCS messages. The 
added training and familiarity with JINTACCS before the 
second comparison test seemed to explain the smaller 
differences . 

The understandability curves that resulted for both 
continuous and burst jamming conform generally to what one 
would expect. The curves were similar in appearance to each 
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other . The experiments revealed that at 3.Q% or more 
continuous jamming at the bit level, about half the under- 
standability or intelligibility of a message is lost. So 
it appears that only a moderate amount of jamming can cause 
a devastating effect on our ability to communicate critical 
information in written messages. 

Apparently little has been published on the understand- 
ability or intelligibility of written communications. Several 
sources were found that cited verbal intelligbility tests, 
and there is even a military standard of intelligibility 
criteria for voice communications systems [Ref. 27] . But 
no standards were cited for written or message communications. 
This seems inconsistent with our high reliance on written 
message communications in today's military environment. 

In conclusion, it appears that messages transmitted 
using the JINTACCS message formats are indeed no worse nor 
better than plain text messages with respect to jamming 
survivability. The ability of military personnel to rapidly 
adapt to the JINTACCS message standards was amply demonstra- 
ted during the first comparison test. The majority of the 
test subjects had received only one and a half days of 
training on the JAMPS computer system. This speaks well 
of its 'user friendly' design. Their JINTACCS scores 
improved after further training but there was still no 
statistical difference in the percent of understandability 
when compared to plain text messages. Since the experiment 
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was conducted using the JINTACCS automated message processing 
system, these conclusions should not be generalized to the 
manual method of using the JINTACCS documentation. Th.e 
questionnaires that were given to the test subjects after 
the first and second experiments showed a general positive 
shift in attitudes from favoring plain text messages to being 
either neutral or favoring the JINTACCS messages. 
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IV. RECOMMENDATIONS FOR FURTHER RESEARCH 



There are several other areas that lend themselves to 
follow-on research. One would he to conduct the same 
experiment using the manual mode of JINTACCS documentation 
rather than JAMPS. This would verify whether there are any 
differences in the percent of understandability between 
JINTACCS and plain text messages using the manual mode of 
processing JINTACCS messages. Another area that should be 
researched is the possibility of 'compressing' JINTACCS 
messages using the JAMPS system. Since the formats are 
standardized, the formatting information would appear on 
the operator's terminal screeJi but would not be transmitted. 
Only the message type plus some method of separating the 
data need be transmitted in order to reconstruct the message 
at the distant end. This would reduce the length of trans- 
mission time and thus should allow more messages to be 
transmitted in the same time period. A third area that 
could be researched would be to analyze the corrections that 
the subjects made or identified in each message during the 
understandability tests. The data were collected during the 
experiments reported in this thesis, but. they were not 
analyzed. These corrections could be compared to the total 
number of characters that were garbled to form another 
comparison of the JINTACCS results to the plain text results. 
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One final suggestion would be to research possible 
specific equipment jamming threats and to repeat the 
experiment using those jamming parameters. 
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COhPU'lER PROGRAM TO SIMULATE JAMMING 
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the characters 8 bit titiciry code. This file contains 63 recor 
one for each of tiie 63 ailowabie characters. 



Build translation tanle of 63 characters and associated bits, read 
in one charcter and its eight bit binary code at a time. 

The table is in file for003.dat for this program. 
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Error- message 
write (6 , 220 ) 



CONTINUOUS JAMMING StCTION 
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Use subroutine transl to translate jammed bits into 
corresponding character 
cell trans 1 (temp, letter ) 

Put character bacK into line 
line(char) = la bl e ( 1 etter , 1 ) 
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BUHST JAMMING StCTION 
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Find ihe I'irsi non-space character at the end of the line. 
The position of the last character, between 1 and 80 , is 
assigned to the value of endlin. 
do 80 i=l,?9 
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The flrsi line through, find randorr bli on which lo begin bursting. 
If ( start. ne. one ) go to 14b 
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/TWO RAMPS.// 

HEADING/SPECIAL INSTRUCTIONS// 

AMPN/CONTACT ROOMER ON IREQ 240.5 PRIOR TO LANDING AT UDTHAN.// 
AKNLDG/N/7 

RMES/CODE 6 PASSENGER HEQUIHES TLC AT DESTINATION.// 



SAMPLE PLAIN TEXT AIRLIB'T REQUEST MESSAGE 

























cH 


o « 




















« 










33 


E-t 


PM 




















33 




Ca4 




2 


35 






Eh 


















O 






PH 


O ^-H 


»• 


< 


<3 






















Pd 


W 


f-H 


PM 


sq 


O 






X) 














PO 




o o 


05 


CH 






t-M 


O Pi 




O 














kP 




Qc; CO 


33 


t— * 




Eh 


P*H 


Eh pm 






















HH h3 


Eh 


2 PM 


05 


3*4 


Eh 


















o 


cH 


<A < 




PD 




o 


o 


05 O 




MM 
















c*4 




-*4 


2: 


HH 






O 2 




CD 
















HH 


W 1-3 


o 


2 


CO 




PM 






<= 1 ; 














o 


►-3 


35 hA 






O 


'w' 


pq 


05 2 




CO 
















« 


Eh hh 


05 




t-M 


Eh 




0-t PM 




CO 














p»p 






Eh 


CO 


0-, 




2 


PM 




hM 














o 


<*: 




O 


HH 


?< 


|3P 


PM 


P 


• 


2 














< 




• O 


2 




PM 


pM 


25 


lO 


CO 
















CO 


CO 


£h O 


MM 


o 




Eh 


E^ 


• CO 


PH PM 














CO 


Eh 


w 


M 


o 


Eh 


05 




X) < 


2 


















CO 


<C| 




as P^4 


O 


f-M 


^ P3 




















w 


P5 ^ 


-aC 


<35 


2 


PH 






P3 


















33 


O 




o 




CO 


l-H 




















PO 


O' PS 


35 




PM 


2 




>- £H 


O 


• 














t-H 




»— • • 


E-* 


PM 


33 


«3 




O HH 




2 














33 


PA 


<«: :s 


HH 


33 


Eh 


P5 


o 


2 >► 


Eh 


<3 














CH 




o 




£H 




EH 


CD 


P^ t— 1 




05 
















W 


G3 P5 






« 




05 


3D £h 


CO 


Eh 














# 


O 


CO PA 






PA 


PM 


< 


O O 


PM 


(30 














>- 


<C| 


fH O 


E^ 


• 




5Q 


O 


pH <q 


Oh 


3D 














<£? 


CO 


1 21 


l-H 




P5 






05 


OD 
















O 


CO 


o o 


OM 


Eh 


t— t 


1-M 


(30 


Ph >-f 


i-M Eh 














O 


w 


cH 




PM 


3D 


»-M 


2 


2: 


O 
















tH 




w 




W 0<-H 


< 


2 PM 


2 




















> 05 


C3 


-*4 


PM 


3 




O 2 


HH 


hO 














Eh 


CO 


»-H S) 






P5 




CO 


PM 




<3 














»— < 


>-H 


Si 


-q 


PM 






05 


05 


2 
















2: 


33 


c*J 


33 


P» 


en 


- N 


PM 


PH O 


<C| 


HH 














33 


Eh 


o ^ 


O 


r— ♦ 


o 


P3 


CD 


2 2 


xi 


05 


















:z. 




Ph 


2 


-a; 


2 


O 


Eh 


05 














P3 




HH £h 








o 


PM 


O 


n 


*3 














:z3 


• 


CO ^ 


CO 




CO 




CO 


P • 


OD 
















o 




3D 




o 


HH 


33 


CO 






2 






»-3 












2 


•b 






23 




£h pm 


£H 


0 






-2L 








>-• 


« 


— 


LO 


EH 




<3C 


Oh 


CD Si 


<3 










\ 






PQ 




05 33 


2 


33 


05 






co 




N 






35 \ 










Eh 


o 


C3> pH 


CO 




EH CO 


PA 








£-< 


< 






Eh 


Eh 


•• « 


Eh 


HH 


CD 


P3 


• 


2 to 


PM 


D- 








p- 






33 


CO 


>- 




PM 


CD 


PM 


>H 


O i> 


PA 


S) 






o 








O 


W 


Eh 


Si 


J3 




r 


< 


CD Si 


PM 










W 








>-• 


t-H Eh 


r-H 




« 


2 


PA 


t-H 


MM 


! 






\:z: 








Eh 




05 <*; 





3M 








Eh 


2 


Si 












o 




Eh 


O 




2 




CO 


PM 


CO 










^ .2- 






t— » ^=4 




•— • CO 


EH 


< 


h5 


CO 


21 


PD 2: 


Eh jo 








>- 






CO 




« P5 


2 




CD 


<3 




2 Si 




I 






C-H 


w 




<a: 




CO 


Q-i 


t— t 


•b 


2 


PH 


CO 


:o 




vf1 






-X^ ^ 


r-5 




o 


O 




33 


O 


E-^ 


r— » 






CO Si 


2 


Si 












»— 1 


pq 


•b 


• 2 


PH 


::M 


CO 




PM 


^ tH 


PH JO 














P3 


CO 


> ^x4 




W 


: 


• 


X5 


Si CD 


HH 








T— i 


< 




»— ( 


1-3 




Si CO 


PM 


Ph 




2 


Eh 


to 


3D 








>-^ « 


w-5 








Eh 


fH CO 








o 




f— 1 ' 


cr 2 












a; 




2: 


O ^ 


«J O 


• 


Eh 


2 


1 


PM O 






'-3 






pq 


Eh 


w 


-O Om 


CO 








O 


Si 2 




CO 




r-i 


I 


r-l 




o 


CO 








£h 




rH 




<A 




HH 




CO 


-a: Cr^ 


O 






« 


33 


P3 X) 


PM 










PM 33 


< 05 






£h 


O 




33 


»-H 


2 


P*5 ^ 


XJ 


Ph 




CO 


Si 


05 £-t 


HH 


P3 










Eh 


H4 


W 


pq .Ai 


Eh O 




t— < 


Si 


Eh 00 


O 


0 




O 


\ £h 




cq 












PM 






3D 


TM 


X. 




o 




1 






w 


•c 


33 PA 


Eh 


33 


Oh 


o 


.H 




Oh 








<— 1 <c 


-34 




• « 


)XJ 




2: <*; 


o; 


=H 


>- 






• tH 




5h 




Cvl 


O C_) 






2: 


Eh 




O 




Q 


Eh 




EH 


oq ^ 




Oh 


O D- 




\ 




o 




rH Eh h3 


53 


t— t 




< 


<a; 


< 




<3 


w yD 




pp 




HH 


CO 




CO 2 


PM 




(Q 






£H CD 


• 


CD 






<q ;z> 


<«: 


CO 


(=H 


»-H 




MM O 


PA 




05 


PM 


PM 


05 :2 






HH ID 0^ 


W 






<a: 




Cr 33 


<*5 


«b 


< 


25 


o» 


O 


<3 




fH 




t— ♦ 


hA P5 


CO 


W 


cr t-3 


o ^ 


(S3 


Eh 


»— t 


i«5 33 


33 


2 


:r> ffi csj 


O 




O 


Pip 


HH 


PC 


W j-5 


t-5 W 


<A 




03 


2 


CH 


0 


o ^ 




« o 


33 CH 




pq 


33 


1-3 


rt HH 


2 


PM 


x; 


pH 


05 


Eh < 


j3D 


x: 


« CSJ 




^ £H 


p=i pq 33 o 


5-i 


<t| 


--- 3: 


o ^ 


' — 


o 


<aC 


< t-M 


3D 


CH 



98 



SEND SHOULD INCLUDE THE FOLLOWING SPECIAL INSTRUCTIONS: CODE 6 PASSENGER 

REQUIRES TLC AT DESTINATION." 
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PLAIN TEXT MESSAGE WITH CONTINUOUS JAMMING AT THE 1.0% LEVEL 
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MESSAGE PACKET INSTRUCTION SHEET 
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ANSWER THE QUESTIONS for each message to the best of your 
ability. 



SUBJECT CUESTIONNAIRE 
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WHICH OF THESE TWO MESSAGE FORMATS ALLOWS YOU TO SPOT CRITICAL INFORMATION 
FASTER? 
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WHICH Oi!' THEHE TWO MESSAGE EORMATS WOULD YOU PREFER TO USE? 
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11. IN WHICH lOfiMAT WERE YOU MOST CONFIDENT OF YOUR TRANSLATION OI THE 
GARBLED MESSAGE? 
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